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ABSTRACT 

In winter 1982-83, a survey of California's community 
colleges was conducted to determine which assessment activities were 
considered most effective and to identify areas needing improvement. 
Responses were received from 99 of the 106 colleges in the system. 
Study findings included the following: (1) assessment procedures, 
counseling procedures,, placement procedures, and research were felt 
to represent the best aspects of college entrance programs; "(2) the 
quality of service to students, interaction between students and 
staff, and professional interaction were also highlighted as program 
strpngtns; (3) when asked to identify the most needed changes in 
assessment practices at their own colleges, the majority of the 
respondents focused on areas related to technical needs, expansion 
needs, the need for increased control over assessment and placement, 
and questions of testing philosophy; (4) respondents tended to have 
reservations about the testing instruments used and the lar:k of 
organized research to validate their programs; and (5) respondents 
recognized the need to evaluate cut-off scores used, to conduct 
follow-up and retention studies, and to analyze services to high-risk 
students. The study report includes sample respondent comments. 
(LAL) 
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With increasing professional and public interest 
in student competencies, a major change is taking place in - 
the procedures of assessment and placement at community 
colleges. One of the results of the student unrest in the 
late '60s and early '70s was a sharp reduction in college 
testing, orientation, and even counseling activities as 
students demanded the right to make their own decisions. 
With the continued decline of SAT and ACT scores, however, 
it has become increasingly clear that student preparation 
for college work is often less than adequate and, 
furthermore, that ill-prepared and ill-informed students 
often make poor academic choices and stumble badly as a 
result of these choices. 

Within tho past several years, some statewide 
community college systems have begun to mandate a structured 
entrance program, even for the "open door" colleges o ' This 
program generally includes assessment, orientation, and 
guidance. New Jersey began such a program in 1978 and 
Florida in 1979 (Rounds, 1983), Professionals in California, 
concerned about lack of assessment and guidance for students 
in the nation's largest community ciolloge system, formed LARC 
(Learning, Assessment, and Retention Consortium) in 1981. 
Tn VJ'nA the state U;gislature i)asscMl a TO million dollar 




matriculation bill which was, however, vetood by the cost- 
cutting governoro . Ihe bill is expected to be brought back 
in 1985, and it is generally assumed that intensified 
matriculation procedures will before long be mandated by 
the California Community College Chancellor's Office. 

As a result of this activity, colleges in California 
are looking closely at their current procedures, to 
determine what is effective and what changes need to be madCc. 
In the winter of 1982-83, 99 colleges of the 106-college 
system (93.4%) responded to a survey of assessment activities 
which asked what they felt was most effective and what most 
needed improvement. The following article presents a 
summary of the data that were gathered, as well as 
representative commients in each area. 

Seventy-four lOf the 99 colleges (74„7%) responded 

f 

to the question which specifically asked for the best 



aspects of college 
analyzing the data 



entrance programs o For the purpose of 
, however, the five that answered only 
''NA'* or ''Too new** will be grouped among the non-respondents; 
69 responses will be used to calculate percentages- 
The majority of the responses can be grouped 
roughly into four major categories: assessment procedures, 
counseling procedures, placement procedures, and research. 
As elements of responses from some colleges fall into 
more than one category,* the tota] number of responses, 5^9, 
(exceeds thi) 69 colloj^es being counted. 
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Thu total number of responses relating to assess- 
ment procedures numbered 50, or 50.5 percent of all 
comments; to placement procedures, 25 (25,3 percent); to 
counseling procedure.s , 15 ( 15,2 percent); and to research, 
7 ( 7. 1 percent ) . An additional two comments are listed 
wi th miscellaneous . 

The 50 assessment procedures responses may be 
further divided into fiN^e responses relating to orientation 
and six relating to im^trurnents^ 14 to' speed and timeliness^ 
and 25 to the comprehensive nature of the program. The 25 
pi acement responses may be divided into placement for specific 
subjects J with 11 relating to lanp:uage arts only and 6 to 
language arcs and math. Eight make general observations 
about placement. Counseling procedures have not been sub- 
divided but tend to deal primarily with specific procedures 
or with interpersonal relationships. Research has not 
been subdivided. Table 1 provides an overview of 

absolute numbers and. percentages of responses in each 

\ 

category. 

# 

Assessment Procedures 

The five common Ls dealing with oHcntacion nc^sions 
primarily nuidu nolo of their oxistonco as an olIocLivu 
part of t.ho gonora] entrance procedure. Comments on 
iri^tricnejits focused on thtur reliability or appropriat(?ness. 



One dealt with the fact that the tests used were power 
tests instead of timed tests, and only one mentioned a 
specific effective instrument: the Comparative Guidance 
and Placement battery. 

Rapid turn-around of testing results was the focus 
of responses relating to speed or timeliness. Typical of 
responses in this category were the following: 

1. Frequent testing, with individual interpre- 
tations of scores for students. 

2. Speed and accessibility of results [within 
20 minutes ] . 

] 

3. Good immediate feedback. 

Two other comments dealt with frequency of testing, one 
with length of testing time, and one with the efficiency 
of moving to a group approach for feedback. 

Twenty-four colleges responded about the overall 
quality of their programs. Sample comments relating to 
the comprehensiveness included the following: 

1. Assessment, counseling, interpretation, and 
course selection all brought together during registration. 

2. Virtually all are tested, and each receives 
a printout, listing reading level, English courses to be 
taken, math areas of strength. 

3. Counselor involvement and curriculum planning 
[are the best] because program was developed by both th(^ 
0ffi(uj of Instruction and Student Services. 



Placement Procedures 

Of the 25 responses relating to effective placement 
procedures, only 8 replies did not specifically mention 
some aspect of lai,iguage arts placement, and even in these 
8, English placement may be inferred as part of the focus 
of the response. Only 6 responses specifically named mathe- 
matics placement, always in conjunction with language arts; 
however, mathematics placement may be implied in at least 
some of the 8 more general responses. 

Comments dealing only with offuctive language arts 
placement included the following "best" practices: 

1. In-class English placement, because of 
objective tests and writing sample and guaranteed access 
to class level determined by placement. 

2. English placement because experience ha.j shown 
accuracy of recommendations; increased retention. 

3. English placement [because] the faculty run 
the process and are committed to it. 

Examples of comments mentioning both mathematics 
and language arts placement included the following as best 
elements : 

1. English/Math placement because students are 
less "set up" to fail in their course work. 

2. Comprehensive nature of English, math assess- 
ment aids students in making wise course decisions. 
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3. The package of R,eading, Writing, and Math gives 
composite picture of student's level of achievement. 

Comments dealing more generally with placement 
included as best elements: 

1. Requiring specific reading/writing levels for 
transfer level course^. 

2. Extensive prerequisite system supported by 

f acu.l ly , 

3. Academic departments are pleased with place- 
ment, student achievement is maximized, and drops and adds 
are cut down. 

Counseling Procedures 

The 15 responses relating to counseling practices 
tended to deal with specific procedures or with inter- 
personal relationships, either with the students or with 
other staif. Examples of positive practices included: 

1. Use of student information sheet for follow-up. 

2. Use Of results for advisement with decision 
left to student. 

a. The personal touch provided by staff produces 
the best results uri'der standardised conditions. 

Research 

Although research was a major area mentaonod when 
'"""'"^^ -"'y -ven cone«e.s p„i„u.<l with 

P.Md,. to their own research. Two commented p„.sit.tv..ly 
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on placintr students on the basis of probability state- 
monts, one observing that such statements for advising 
are "understandable and defen.-^ibl e. - Two others said they 
u-ere beginning to develop a body of r.^search, one comrnonti 
that empirical data was "the only defensible basis for 
such a program. " 

The three other respondents indicated they had 
already accumulated considerable data; one mentioned data 
extending back fifteen years, and the other tied in the 
college's research to its curriculum, saying; "The pro- 
gram is based on substantial experimental research, and 
the curriculum has been evaluated to demonstrate increased 
student retention, GPA, and skills growth.". 

Areas Most in Need of Examination: 
Self -Assessment 

The other research question explored changes 
in assessment as perceived most needed in the colleges' 
own programs. Seventy-nine colleges (79.8%) responded 
to this question; however, eliminating the four responses 
that were marked "NA" or "None," leaves a total of 75 
responses to be counted. Five of the 20 colleges not 
responding specifically indicated they had no programs and 
two that their programs were too now to evaluate. 

The responses of the 73 colleg(;H can be broadly 
categori/,(Kl as fittinf^ under technical needs , (expansio n 
.'IL'il^.l!! ' nf!(;(J <'or increascul t;ontfo l_over assessment and 



placement, and questions of testing philosophy. There 
is also a small miscellaneous grouping. Since elements 
ol some responses fit into more one category, the total 
number of responses, 107, exceeds 75. (See Table 2). 

Forty-seven comments (43.9 percent of all comments) 
fit under the technical needs category and can be further 
divided into 24 responses relating to resear'ah needs, 16 
responses to con-cerns about inatru;mnt a, and 7 to comments 
about ccrnputars. The 29 responses ( 27 . 1 , percent ) grouped 
under expanj^ioj^n^^ involve personnel: ,paae^ or pvogvania. 
Of the 17 comments (15.9 percent) about pla cement into 
various disciplines, 6 refer both to language arts and 
mathematics placement, 1 comments on mathematics and 
chemistry placement, and 3 deal exclusively with mathe- 
matics placement. An additional seven references deal 
with language arts placement alone, three of which express- 
concerns about English as a Second Language programs (ESL). 

A number of colleges expressed a concern about 
the need for further analysis and clarification of their 
own U2iiiingj)luj_^^ 8 responses (7.G percent; fell 

into this category. An additional (3 comnuMits (5.6 percent) 
could be categorized simply as xnxsoeU^oxxs. Table 2 
provides information about numbers and percentages 
responding • 



Technical Needj-; 



Research Needs 

01' the various needs of a technical nature, the 



largest group 
Research Needs 



□f responses, 24, can be categorized under 
Of these, 8 related to a search for more 
appropriate cijt-off scores for advising purposes. Sample 
commenLs included the following needs for 

1. Refsearch[ ing] local norms. 

2. Establishing scores that correlate with 
success in courses, [doing] longitudinal research. 

3. Cjit-off scores . . . because scores were 
established a|rbi trari ly . 

Otherj colleges observed the need for general stu- 
dent follow-U|P and longitudinal research (four comments); 

three spoke to their greatest need as being increased 

i 

information ^bout retention; and two mentioned further 
work on currjculum. The other concerns were varied, as 
is indicated by these examples: 

f 

1. fNeed] identification of high-risk students. 

2. [Need to study] diagnostic aspects of the tests 
in terms ol' lower levels; not enough details to assist 
most underpr(,>i)ared students; not enough item analysis. 

3. Need information-sharing. 
Assessment Instruments 

Fourteen responses dealt with the need for improved 
assessment instruments. Four questioned the value of 
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specific instruments: 

1. Problems using Nelson-Denny as a placement 
t9ol. because it was not designed as a placement tool. 

2. Growing dissatisfaction with Davis and Coop 
for proper placement of students. 

3. SCAT and Coop English are old tests. We need 
shorter, easily-scored test that has a high predictive 
validity with our transfer-level courses. 

The remaining ten comments dealt with similar con- 
cerns about testing instruments in general. For example: 

1. Question oi reliability and validity of current 
instruments used. 

2. Would like to see writing and math proficiency 
tests; [have] ■ question of validation. 

3. Testing instruments need to be reevaluated 
and constantly upgri'ded. 

Computers 

Of the ten responses that dealt with the need to 
utilize the computer better, one concern was for 

"computerizing the system," and three were primarily 
concerned with xnterfacing testing and scoring with the 
computer, either in regards to doing the actual scoring 
or getting the scores into the computer for easy avail-, 
ability. Two were interested in using the computer for 
checking prerequisites, and another col lege--al ready using 
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the computer and a prescriptive student printout--wan ted 
Lo evaluate the language on the printout. 

E xpansi on 

Twenty-nine responses focused on the need for 
expansion: eight commented on the need for more space 
to centralize, and three specifically mentioned the need 
for additional staff. Ten commented on the need to expand 
the testing itself: \ 

1. Need for general assessment prior to enroll- 
ment because students are not prepared for courses. 

2. Comprehensive assessment ... is needed but 
very complicated. 

3. We are working on expansion of the college's 
assessment program. 

Two referred to total district involvement in examining the 
process. 

In addition to other observations relating ''to such 
items *as expanded scheduling of classes and orientations, 
an additional five responses indicated the more critical 
need was for sweeping change; 

1. Complete review necessary. 

2. All phases, because not in place to date. 

3. [Assessment] not required, not enforced. 

4. Everything. 

5. Too numerous to mention, because I would only 
become more frustrated. 

I.) 



Absoss menl and 
Plac ement N oeds 

The third caLegux-y of majoi* needs dealt with 

various problems in testing and placing students in 

specific subjects. Seventeen responses fell into this 

category, seven of which focused only on language arts 

needs, three only on mathematics, and seven on multiple 

subjects. Comments in relation to English were concerned 

primarny with reading assessment and the need for 

improved ESL assessment. Sample reading cormnenls were: 

1. [Problem] allowing students to enroll in 
courses requiring basic reading/writing skills but not 
requiring test scores at certain levels, because students 
are committing academic suicide. 

2. [We are in the] process of re-examining impact 
of reading ability across the curriculum and how reading 
ability should impact on placement recommendations and 
requirements . 

Two of the comments, about ESL placement were tlic 
following : 

1. [Need] assessment of ESL students, because 
of increasing numbers . . . who cannot speak or write 
Engl ish , 

2. English [programs ] for non-native speakers 
growing too fast to be effective. 

The tliree comments that were exclusively con- 
cerned with mathematics placement included one which 
indicated the need to expand above basic level assessment, 

14 



us "currently we only examine basic math, not algebra or 
above. " Seven additional comments spok"e to a combination 
or placement problems, expressing concerns for such 
things as: 

1. Math and chemistry testing, because it has 
apparently strongly affected our enrollment patterns. 

2. Overly heavy emphasis on English to detriment 
of reading and math. 

3. Better control over English and math classes. 

Testing Philosophy 

Among those responding to the question about what- 
ever most needed re-examining, eight colleges commented 
on the basic need to determine the college philosophy of 
assessment and placement. These responses indicated a 
wide range along the continuum of points of view. Among 
the group that had apparently already accepted the concept 
of testing, one college observed that its Engliih place- 
ment tests "seems to show wo value such skills," and 
another assumed testing was of value but complained, "Too 
much information is kept from the students about the 
significance , details of the test results." A third 
inillcatea: "We have a very active committee reviewing 
the whole issue of testing and placement — a reflection of 
our dissatisfaction with th(3 current process." 

Another four col legos indicated they were simply 
(luestioning whom to test, and how, wh(?ther testing should 
mandatory, and how to handle? "drop-in" studcMits. 
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Three other colleges expressed considerable concern 
about, the potentially negative impact ol' testing, even 
•while indicating they would be re-examining their own 
posi ti ons : 

lo There is concern that general assessment would 
load to elimination of students at lower skill levels, and 
we do n^/t want that to happen, 

2. .We do not believe in mandatory testing or 
placement o It is time, however, for us to review our 
ideas to determine if there are better ways to serve 
our students o 

3o We have been adamantly opposed to placement 
testing and the abuses that grow out of categorizing 
adults , We need to consider if we need such a program 
as placement/assessment because of legislative mandates. 

Conclusions 

Community college respondents, when looking at 
their own programs, find much to be proud of, often 
identifying the quality of service to the students and 
the interaction between staff and students and among 
the professionals themselves. On the other hand, they 
tend to have reservations about the instruments they 
have been using and the lack of any organized research 
to validate the effects of what they have been doing. 
They recognize the need to evaluate cuL-ofl' scores used, 
t () do f o 1 1 ow- u p and re t e n t i n s t ud i e s , a n d t o a n a 1 y 
s(Mwir'es especially Lo high-risk stu(i<uit.s, as wc^l.l as Lo 
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Incroasu inloriiiaL ion exchant^o among tho various c(Ulot,';oSo 
A Tow conlinuo to challenl^e the value of testing itsulfo 

The concerns expressed by the colleges were taken 
into consideration when the Chancellor's Office of the 
California Community Colleges developed the Matriculation 
Model that was passed by the state legislature in the 
fall of 19S4o This model mandated that participating 
colleges require assessment, orientation, counseling, 
follow-up for high-risk students, and researcho 
Approximately 50 colleges competed for the funding that 
the bill made available, and interest in the pilot project 
was high throughout the stateo The Governor's veto in 
September, because of his budget concerns, was a major 
disappointment; however, it may safely be assumed that 
another version of the bill v/ill eventually be approved, 
and most colleges are in the process of developing much 
more structured admissions procedures « The next few years 
will see a dramatic turn-around as these ''open door*' 
institutions take a closer look at entering students. 
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Table 1 

Most AdmiroKi Assessment /PI acernent Practices of Calil'ornia 
Community Collei^os: Self-Evaluation, By Numbers 
and Percent, 1982-1983 



Sub- 



t of 
Coileses 
Responding 



I of 
Total 
Responses 



A Y* f^n of nmmf^ n H n "f t nti 

[\ 1. \^ iX \J JL \^ V^Ullll O li l.^ ct L JL It 


Tot n 1 


Tot n 1 






Assessment Procedures 


50 




72. 5 


50. 5 


Orientation 




. 5 


7.2 




Instruments 




6 


S.7 




Speed 




14 


20. 3 




Comprehensiveness 




25 


36.2 




Placement Procedures 


25 




25. 3 


25. 3 


Language Arts 




11 


15.9 




Math and 
Language Arts 




6 


8.7 




General 




8 


11.0 


> 


Counseling Procedures 


15 




21.7 


15.2 


Uosearch 


7 




10.1 


7. 1 


Misco 1 1 anoous 








2.0 



N - (:!9 

*Th is total exceeds total N because some responses 
were divided into more than one category. 
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Table 2 

Areas of Concern in Assessment /PI acemcnt Practices of 
California Community Colleges: Self-Evaluation, 
By Number and Percent, 1982-1983 



Ar6as of - Concern Total 



Sub- 
Total 



Technical Nee^ls 

Research 

Assessment 
Instruments 

Computers 



47 



24 

16 
7 



% of 
Colleges 
Responding 
(75) 



62. 7 
32. 0 

21. 3 
9. 3 



% of 
Total 
Responses 
(107*) 



43.9 



Expansion 



29 



38.7 



27. 1 



Placement 

Language Arts 
Only 

Mathematics 
Only 

Combination 



Phi 1 osophy 



Mi see 1 ] anoous 



N = 75 



17 



6 



3 
7 



25. 7 

9.3 

4.0 
9.3 



10.7 



8.0 



15.9 



7.5 



5. G 



*This total exceeds N because^ .some res(){)nses W(Mm.' 
divided into move than one category. 
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